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Four-State Electronic Random Nunber Generator 

This study provided an opportunity to detcrmine whether the re- 
mote sensing capability could be extended to the perception of the 
internal state of a piece of electronic equipment, For this purpose, 
an automated experiment designed around a four-state electronic random 
number generator was initiated. The solid-state anshane has no moving 
parts and provides no sensory cue to the user as to its target genera- ‘ 
tion. 

In order to determine unambiguously whether a result was meaning- 
ful, the Poi iene Biceveey was used. First, the randomness of the 
machine was verified by over 10,000 pre-experiment trials (details 
given below). eee the subjects interacted with the machine to. 
generate the datas Third, for any subject whose score was ee 
ie Hiabisties of the tachane during the successful experiment were 
tabulated to insure that the machine had not departed from randomness 
in the period in which a significant result was obtained. Fourth, a 

2 Bune generating a good score was asked to repeat the entire experi- 
ment after a one onsh lag period. Finally, the entire data analysis 
was carried “out by an independent statistics group at SRI. Con Richard Linglotin), 

The machine configuration provides as a target one of four art 

slides chosen randomly ee 1/4) by an electronic random generator. 


The generator does not indicate its choice until the subject indicates 


his choice to the machine by pressing a button (see Figure 11). (The 
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FIGURE 11 Four-state clectronic random number generator used 
in this experiment. An incorrect choice of target 
is indicated. Two of the five “encouragement lights" 
at the top ef the machine are illuminated. The 
printer to the right of the machine records data on 
fan-fold paper tape. 
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oscillator sends pulses to an electronic "scale-of-four' counter which 
passes through each of its four states 250,000 times per second. ‘The 
state of the counter is determined by the length of time the oscillator 
has run, that is, the time between subject choices.) As soon as the 
subject indicates his choice, the target slide is illuminated to provide 
visual and saaieee, (bell if correct) feedback as to the correctness 

, ¢ 
or incorrectness of his choice. Until that time, both subject and 
experimenter remain ignorant of the machine's choice, so the experiment 
is of the double-blind type. Five legends at the top of the machine 
face are illuminated one at a time with increasing correct choices (6, 
8, 10, --.) to provide additional reinforcement. The machine choice, 
subject choice, cumulative trial number, and cumulative hit ate are 
recorded stutonstiea vig ae a printer. Following trial number 25, the 
machine must be reset manually by depressing a RESET button. 
'A methodological feature of the machine is that the choice of a 
target is not forced. That is, a subject may press a PASS button when 
he wishes not to guess, in which case the machine indicates what its 
choice was. ‘The machine thus scores neither a hit nor a trial and then 
goes on to make its next selection, Thus, the subject does not have to 


guess at targets when he does not feel that he has an idea as to which 


to choose. 
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Under the null hypothesis of random binomial choices with probability 
1/4 and no learning, the probability: of observing 2k successes inn trials 


is approximated by the probability of a normal distribution value, 


> (« ; “ yore 


The design objective was to build a four-state machine, with each 
state equally likely to occur on each trial, independent of the past 
sequence of states. te the machine meets this objective, it should not 
be possible to devise a rule for future play that significantly differs 
eon chance. A simple example of such a Rite would be to select the 
machine state observed in the Suscehaue dys if this strategy were 
to produce scores significantly above chance (25 percent hits), we 
would peaeee the igsotieats of randomness of the machine under test. 

Before experimentation machines purchased from Aquavins Electronics, 
Albion, California, were extensively tested for randomness. paca wend 
analyzed on a CDC-6400 computer, and the machine finally selected for 
use met established criteria for randomness. 

In devéloping randomness tests, we are guided in part by a knowledge 
of the machine logic. When one of the four choice keys ie the pass key 
is depressed, the current machine state is displayed; then a brief time 
after release of the key, a new machine state is established (but not 


shown to the subject) by sampling the instantaneous state of a high- 
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speed four-state electronic counter. For the machine to be random, 
the times of dwell of the counter in. each of the four states must be 
precisely equal; otherwise, the distribution of outcomes will be biased. 
The first vandouvess test is thus based on tallying the number of 
occurrences of each of the four states. This test should detect a 
stable bias, yet may miss a drifting bias. To test for this second 
possibility we also tally the distribution of outcomes in each group 
of 100 trials, then compute a likelihood ratio test statistic (see 
below) for each group. Under the null hypothesis of equal likelihood 
of the four Peres these statistic values are distributed en 
mately as chi-square with three degrees of freedom and their sumvioe 
m groups sists iniead approximately as chi-square with three m degrees 
of freedom. This test may also detect stable bias, but is not 
powerful for oe ceueae as the first eae: Variable bias of still 
a shorter period, if substantial, can be tested for by tallying the 
frequency with which the previous machine state is repeated; an overall 
repeat ratio ("all") significantly above 0.25 is indicative of such bias, 
If for any reason the sues were to fail to sample the counter 
to establish a new state, the previous machine state would be repeated. 
To test for this possibility, we tally the number of repeats following 
the depression of each key. A repeat ratio significantly greater than 


9.25 should be considered a danger signal. 
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; We also tally the initial machine states following reset and the 


transitions between states. In cach case, the number of occurrences of 
each of the four possible outcomes should be approximately equal. When 
repeats are deleted from the sequence of trials C"nondiagonal transi- 
tions"), the four states should also be approximately equal in frequency. 
In testing the null hypothesis of four equally likely outcomes of 
a trial, a likelihood ratio test is used. The statistic 
4 
Ss ; n/4 
-2 n tn te 
ho n, 
i 
i=l 


under the null hypothesis is distributed eppeoeiauealy as chi-square 
with three degrees of freedom, with rejection for ieee tahea of this 
statistic. ae computer program used in testing randomness includes 
a subroutine for coupenise the probability of a chi-square value as 
large on larger than on observed. 

In testing the null hypothesis that the probability of a. repeat 
is 0.25, the binomial sesnan ites of obtaining the observed number K 


or more repeats in N trials is computed. For K greater than 1000, a 


normal distribution approximation is computed, assuming the statistic 
K - 1/2 N 
Bee canoe) 
N 3/16 
to be approximately normal with mean zero and standard deviation one. 


oe 


*Alexander Mood, Introduction to the Theory of Statistics (McGraw Hill, 
New York, 1950). sf 
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The typical test pattern used was six passes followed by 25 choices 
of one color, repeating this for each of the four colors. In this way 
each of the five keys other than resetwere given approximately equal 
use. Typically, 2000 to 6000 trials were made in cach sitting. In the 
absence of any unusual results in the randomness tests, a minimum of 
10,009 trials were made before using a machine with experimental subjects. 
With 10,000 trials, the expected fraction of repeats is 0.25 with a 
standard deviation of 3/200 = 0.00866. | 


A computer listing of the results of randomness tests is included 


in Table 1, No significant departures from randomness were observed. 


Subject Data 

Data was collected from subjects Sl through SG. Each subject was 
asked to isnpiees ae S6ubrtal runs (i.e., a totar of 2500 trials each). 
The results are tabulated in Table 2. (One subject, S3, declined to 
complete the 2500~trial run, indicating a lack of rapport with the 
machine and, hence, a eke motivation for the task.) For the six 
subjects, only one (S2) scored significantly above ehaneé. For the 
2500 trials ‘that eieseet averaged 29.36 hits/100 trials rather than the 
expected 25/100, a result whose a priori probability under the null 
hypothesis is p = 3x10", His scores are plotted in Figure 12. 

The statistics of the machine during the successful run of subject 


S2 were tabulated for the entire 3488 machine transitions (2509 choices, 
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departure from random expectation during the successful run, and therefore, 


the significant result cannot be attributed to machine malfunction, 

At a later time, subject S2 was asked to repeat the entire exper- 
iment, and he was able to replicate successfully a high mean scoring 
rate (27.88/100 average over 2509 trials, a result whose a priori 

oe -4 
probability under the null hypothesis is p = 4.8x10 ). 

We thus conclude from this part of the study that of the ‘six sub- 
jects tested, one subject (S2) gencrated a significant result replicable 
and not attributable to machine malfunction. 

Finally, the study taken as a whole (15,750 trials) was Significant, 
yielding an average scoring rate 26.47 hits/100 trials, a result 

act a eclie. -5 
whose a priori probability under the null hypothesis is p = 1.1x10 1 
The bit rate associated with the information channel can be cal- 
culated from ‘ 
R= H(x) - H (x), 
se ¥y 
where H(x) is the uncertainty of the source message containing symbols 


with a priori probability P. 
er pace iy 


H(x) = > Plog P, 
i a>. 7% 
: i=] 


and H (x) is the conditional entropy based on the a posteriori pro- 
y ; es 


babilities that a received symbol was actually transmitted 


H (x) = - ) P(i,j) low. P43). 
y Z iL 
i,j=l 


e 
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rst run, with = 1/4, P(k,k) = 0.2936, and an average of 
30 seconds per choice, we have a source Janeeeentaes H(x) = 2 bits and a 
calculated bit rate 
R w 0.007 bits/symbol 


or 4 
R/T se 2x10 bits/sec. 
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Table 1 
PRE-EXPERIMENT RANDOMNESS TESTS * 


ee ret Ae NE TD me NN EN eek ee my ey ee ey ee ne meee eens mney eo 


Buttons Number 
aa nS £ Chi-Sq. 
Yellow | Green Blue ! Red : ae 
idk ctr eeh ees ee Ee ee Trials | 
Initial states 107 116 113 128 464 1.996 
Transitions Y 728 | 764 765 790 3047 2.5973 
To G i 777 { 7384 773 863 3197 6.745 
Fron ye B 776 796 810 773 3155 1.158 
R 787 852 803 805 3247 2.877 
All states | 3175 | 3312 3264 3359 | 13110 5.667 
Nondiagonal , : 
transitions 2340 2412 2341 2426 9519 2.630 
Diagonal 
transitions 728 784 810 805 3127 5.414 
(ES Spe TRE merch sane Bionomial 
Key N~-Trials Repeats Ratio 
a exer aes Perea gare fee ___Prob._ 
Diagonal Yellow | . 2774 705 0.2541 0.313 
transitions 
as a function Green _ 2755 674 0.2446 0.748 
of key press 
Blue 2761 706 0.2557 0.250 
Red 2742 667 0.2433 0.793 
Pass 1614 375 0.2323 0.953 


All 12646 3127 0.2473 0.763 


Randomness in groups of 100 trials: 


Chi-sq. = 299.6141 D.F. = 345 Prob. = 0.9628 


ne ae er at rt ee I ER A A RAR a A rf 
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: TABLE 2 


FOUR-STATE ELECTRONIC RANDOM NUMBER GENERATOR 


' BINOMIAL 


MEAN SCORE/100 TRIALS 


SUBJECT OVER 2500 TRIALS PROBABILITY 
$1 25.76 0.22 
S2 29.36 3x 10! 
83 24.67 (750 trials) 0.60 
$4 25.76 0.22 
ests) "25.20 0.42 
S6 25.40 0.33 
. -4 
S7 27.88 4.8 x 10 
(replication) ; 
Ail trials 26.47 1.1 x 10 


(15750 trials) 
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TABLE 3 


: MID-EXPERIMENT RANDOMNESS TESTS. 


BUTTONS Number 
: of Binom. 

Initial States 24 29 23 100 

Transitions 818 

To 844 

867 

859 

“IALI States 3488 
Nondiagonal 

Transitions 2514 

Diagonal 
Transitions 874 
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30 


Out of 100 trials/run. 


20 


HITS/RUN 


10 


0 10° 20 30 


RUN NUMBER - 100 Trials/Run 
p= i per trial 


FIGURE 12 DATA SUMMARY FOR SUBJECT 2 
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RT and LT hand trials. 


Spatial Relations 
Subtest of the PMA 


Requires menta 


rotated in 2 dimensions. Score: 


1 rotation and identification 


Score: 


of 


no. correct — 


Gottschaldt Hidden 
Figures Test 


lines of more complex 


figure. Score: Time and 


Total time (sec)- 


figures 
no errors. 


Requires tracing outline of simple figure hidden tithin 


no correct. 


Avg. 


60 52 


outst. outst. 


Test Deseriprion : 
en aaa i — seers a 
a ae 
. ek ee a 8 I Da fa eo a 
Halstead Category Nonverbal test requiring abstraction of conceptual relation- : j le 33 36 6 : 
Test ships. Score: Total errors. 7 8 
———+ ares = 
Tactual Performance Requires placement of 10 geometrically shaped blocks in 
Test their correct locations on 4 formboard while blindfolded. 16,4 11.8 Pet Ba 11.4 6.9 
Separate RT, LT, and bimanual trials. 
Score: Total time (min.). 
Speech Perception Discrimination of non-word speech sounds. 4 9 0 
Test Score: Total errors. Se A er ees 
Seashore Rhythm Test Discrimination of nonverbal rhythms. Score: Number correct. 27 23 28 29 26 29 
os 
Finger Tapping Test Measure of finger oscillation rate for 10-sec- period, both RT/LT RI/LE  RI/LT = RI/LT RT/LT = -RT/LT 
RT and LT hand trials. Score: No. taps/10 sec. 53/50 53/49 48/47 54/53 47/47 48/43 
Trail Making Test Requires connecting numbered circles in order from 1 to 25. 40 16 18 19 
(Part A) Paper and pencil task. Score: Total times (sec) 30 27 
Trail Making Test Requires connecting alphabetic and numbered circles by 56 50 55 50 54 7 
(Part B) alternating 1+A*2>B, etc. Score: Total time (sec) 3 
Knox Cube Test Measure of attention span and immediate visual memory. 
Score: Number correct. 
Raven Progressive Nonverbal intelligence test involving spatial matrices. . 
Matrices Score: Number correct. 55 60 54 
Verbal’ Concept Requires abstraction of verbal conceptual relationships. , 
Attainment Test Score: Number correct. 22 24 27 23 : 21 24 
n . P : ‘ : 7 Total: 
Buschke Memory Test Requires learning a 20-word list in a maximum of 12 trials with 5 
repetition of words omitted after each trial. Score: Max. no. ee 17/20 18/20 19/20 20/20 20/20 | 
words correctly remembered; List: no- words consistently remembered 8/20. 14/20 11/20 16/20 15/20 16/20 
iz (8 trials) (7 trials} 
Grooved Pegboard Test] Requires insertion of 25 pegs in their holes in a pegboard. Both RE/LT RI/LT RT/LT «-RT/LT—RT/LT RT/LT 
76/74 69/70 58/67 59/67 gen 48/50 
(2) 
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